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Operant vs. classical conditioning 


Classical : relationship between stimuli (CS and 
US) is important, and predicts a response (UR) 

Operant : relationship between stimuli 
(condition) and response is important, and 
predicts a stimulus (reinforcer) 
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Selective reinforcement 

http://www. youtube.com/watch?v=guroaQRFsX4 

What is learned? 


Thorndike's puzzle boxes 
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- 3URE 5.2 

es "o escape from Box A during successive trials. The longest latency was 
-.econds; the shortest was six seconds (Notice that the axes are not labeled as 

’• 'jre’s original report.) 
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Types of reinforcement 


Procedure 

Contingency 

Result on behavior 

[1] Positive 
reinforcement 

Response yields 
appealing outcome 

Increase in response 

[2] Punishment 

Response yields 
aversive outcome 

Decrease in 

response 

[3] Negative 
reinforcement 

Response prevents 
aversive outcome 

Increase in response 

[4] Omission 
training 

Response prevents 
appealing outcome 

Decrease in 

response 


Omission training for self-injurious behavior 
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FIGURE 5.7 

Rate of Bridget's self-injurious behavior during bas< 
which a DRO contingency was in effect (20-24. ar 


32-72) 


is (1-19. and 25-31) 
; rom bndberg et al.. 


J during sessions 


Lindberg, Iwata, Kahng, & DeLeon (1999) 
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What is associated? 

Him ■ v 

c-^S-S A-AS-L • • L-S O—O I.-L 



0.9_ 

( 1* _ 

/// 

o.- 


stimulus 


\ 


response 


^-— S ^\.nnX _ 




V .« 

0.3 

•r ,, ._' r 1 --- 

- > 

re inforcer 


i 

1 | i- 

Pre 1 2 J T 




BI<KkN of 3 trials 
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Mellgren (1972) 


What is associated? 


Light + Lever press sugar water 

Tone + Lever press food 



stimulus 

-now satiate the rat on sugar water 




Rat continues to press lever in 
presence of tone but not light! 


response 

Colwill and Delamater (1995) 



re inforcer 
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Nature of the reinforcer 

• Reinforcer can be neutral (St. Claire-Smith & MacLaren, 1983) 

— Rats learn [1] Lever press noise 

— And then later are classically conditioned: 

• [2] Noise (US) Food (CS) 

• [3] Light (US) Food (CS) 

— Group [2] presses lever more later. 

• Reinforcer can be secondary 

— First learn [2], then [1] 

— Rat will press the lever just for the noise (skinner, 1938) 


Peak shift in operant learning 
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Relational responding 


turn left 



^ turn right 



Relational responding 


Training : 


turn left 


turn right 
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Dimensional learning 


Training Reversal Nonreversal 


Reinforced 


Not reinforced 


Which is easier, reversal shift, or nonreversal shift? 



Shaping 

http://www. youtube.com/watch?v=drnnulHw5CM 
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Contiguity vs. contingency 


Phase 3 Phase 4 

.05 - .0 •+■- 05 - 05 



HGl'Kt. 3.12 Response** per hour for rats when there is a contingency between 
preying and reinforcement and when there is not. Source: From I.. J. Hammond. 
Journal of the F.xfwrlmental Analysis of behavior, The effect of contingency upon the 
aopeiittve conditioning of free-operant behavior, 34, 297-304. Copyright © 1980 bv 
tt.- s.««iy (or live 1. perlrncnl.il Analy.laof Behavior, Inc. Ktprinlcd by permlwlon 
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Partial reinforcement 

• Partial reinforcement extinction effect 

• Kids do more work in school following partial 

than full reinforcement (Eisenberger, Heerdt, Hamdi, Zimet, & 

Bruckmeir, 1979) 



Learned helplessness 



Ehcapi Inihcapi CowtAOt 

-P> OS-1 ^ P>.0S- 


-P> .05 - 

Fic.uke 9. Group means, standard deviations, and significance levels of three 
dependent variables for the instrumental pretreatment-cognitive teat for help¬ 
lessness experiment: mean trials to criterion for anagram solution. 


Hiroto & Seligman (1975) 
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Next class: 

Transient forms of memory 
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